A generalized integral fluctuation theorem for general jump processes 
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Using the Feynman-Kac and Cameron-Martin-Girsanov formulas, we obtain a generalized integral 
fluctuation theorem (GIFT) for discrete jump processes by constructing a time-invariable inner 
product. The existing discrete IFTs can be derived as its specific cases. A connection between our 
approach and the conventional time-reversal method is also established. Different from the latter 
approach that were extensively employed in existing literature, our approach can naturally bring 
out the definition of a time-reversal for a Markovian stochastic system. Intriguingly, we find the 
robust GIFT usually does not result into a detailed fiuctuation theorem. 
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I. INTRODUCTION 

One of important progresses in nonequilibrium statistic physics in the past two decades is the discovery of a various 
of fluctuation theorems. They arc thought of to be a nonperturbative extension of the fluctuation-dissipation theorems 
in near-equihbrium region to far-from equilibrium region. According to their mathematical expressions, these theorems 
are loosely divided into two types. One is caUed the integral fluctuation theorems (IFT) P, 0, 0, H, 0, 0, H, H [13, [lH , 
and the other is called the detailed fluctuation theorems (DFT) [1, [H [H [13, El- The former follows a unified 
expression 

(exp[-^]) = 1, (1) 

where ,4 is a functional of a stochastic trajectory of a concerned stochastic system, and angular brackets denote an 
average over the ensemble of the trajectories that start from an given initial distribution. For instance. A may be the 
dissipated work along a trajectory and eq. H]) is the celebrated Jarzynski equality (JE) [U, [1|- 

Due to the insightful work of Hummer and Sza bo I l6l , we now know that these IFTs have an intimate connection 
with the famous Feynman-Kac formula (FK) Il8l| in the stochastic theory of diffusion processe s [l9l| . Recently, 
several works including us reinvestigated this issue from mathematic generalization and rigors [ill . [20l . |21|.|22|. [23j . One 
of findings is that the application of the FK formula in proving the IFTs is based on a construction of a time-reversed 
process of a diffusion process [13, [l^l • Because the definition of a time- reversal has some certain arbitrariness [l^] , 
we have obtained a generalized IFT (GIFT) by constructing a time-invariable integral and employing the FK and 
Cameron-Martin-Girsanov (CMC) formulas [H, [1H| simultaneously, and the several IFTs [3. [sl. [tI. were specific 
cases of the GIFT . We should emphasize that all of the works were concerning with continuous diffusion processes 
described by Fokker-Planck (FK) equation. 

In addition to continuous case, there are still another kind of stochastic jump processes described by Markovian 
discrete master equations. In many practical physical systems, a description of discrete jump process is more satisfac- 
tory than a description using continuous diffusion process, e.g., the systems only involving few individual objects [2(1 
One may naturally think of that there exists a GIFT in discrete version, and the discrete IFTs in literature [J llOl. l27l| 
are specific cases of it. At a first sight, this effort seems trivial since a continuous diffusion process can be always dis- 
cretized to a discrete jump process. However, In addition that one hardly ensures that the "discrete" GIFT achieved 
in this way is really exact, we know that a jump process is not always equivalent to a discretization of a certain 
continuous process (26j . Additionally, to our knowledge, fewer works have formally studied the IFTs for general 
jump processes employing the FK and CMC formulas, though several authors have mentioned this possibility [28l. [29j 
earlier. Therefore, in our opinion a rigorous derivation of an exact GIFT for discrete jump processes is essential and 
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meaningful. In this work we present this effort. Because we focus on the general Markovian jump processes, fewer 
physics are mentioned here. The detailed discussions about the specific IFTs in previous literature [lOj should make 
it up. 



II. GENERALIZED INTEGRAL FLUCTUATIONS FOR JUMP PROCESSES 



We start with a Markovian jumping process described by a discrete master equation 

dp„{t) 



dt 



m)Y>{t)l 



(2) 



where the A'^-dimcnsion column vector p(t) = (pi, • • ■ ^pn)^ is the probabilities of the system at individual states 
at time t (the state index n may be a vector), the matrix element of the time-dependent (or time- independent) rate 
Hmn > (m 7^ n) and H„„ = — X^m^tn Hmn- Given a normalized positive column vector f(t) = (/i, ■ • • , /tv)"^ and a 



N X N matrix A that satisfies conditions /„H„i„ + A„„ > (m 7^ n) and A„„ = 
inner product f^(t')v(t') is time-invariable if the column vector v(t') ~ (vi, ■ ■ ■ ,vn)"^ satisfies 



Z^m^^n A"!"' state that an 



dVnjt') 
dt' 



- [dt'i^ Hf]„ v„ + /-I [(Ai)„ - (at 



(3) 



where the final condition of w„(<) is Qn {t'<t), and the column vector 1 = (1, • • • , l)""". This is easily proved by noting 

a time differential df f^(i')v(t') = dt>{{^)v + t^dt>{v) and the transpose property of a matrix. Employing the 

Feynman-Kac and Cameron-Martin-Girsanov formulas for jump processes (a simple derivation about the latter see 
the Appendix I), eq. ([3]) has a stochastic representation given by 



Vnit') = E 



"n.t' 



and 



J[x,f,A] 



4(r)Ax(r)x(r)dT 



k 

E 



In 



1 + 



^x(t+)x(tr)(*i 



/x(t-)(*i)Hx(t+ 



(4) 



, (5) 



the expectation i?"'* is over all trajectories x generated from eq.® with fixed initial state n at time t' , x(t') is 
the discrete state at time x(t~) and x(i^) represent the states just before and after a jump occurs at time ti, 
respectively, and we assumed the jumps occur k times for a process. The readers are reminded that the first and last 
two terms of the functional are the consequences of the FK and GCM formulas, respectively. We see that the last 
term is significantly different from that in the continuous processes [eq. (11) in ref. [23]. Combining the stochastic 
representation and the time-invariable quantity and choosing t' = 0, we obtain the exact discrete GIFT for a jump 
process. 



f:/™(0)i?-°{e-™g.(,)]}=.F(Oq 



(6) 



Particulary, the right hand side of the equation become 1 if q = 1 . 



III. RELATIONSHIP BETWEEN THE GIFT AND EXISTING IFTS FOR JUMP PROCESSES 

The abstract eq. ^ includes several discrete IFTs in literature. First we investigate the case in which the discrete 
system has a transient steady-state solution H(i)p'^''(i) ~ 0. Choosing the matrix A=0 and the vector f(i) = \f^{t), 
eq. ([5]) is immediately simplified into 

J = - f drP^^^,^{T)dT (7) 
JO 
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If one further thinks of p'''' satisfying a time-dependent detailed balance condition Hmn (t)Pn (0 = ^nrnit]Em (*) i 
above functional may be analogous to the dissipated work and eq. © is the discrete version of the JE [11,13. On the 
other hand, if p'^'^ is a transient nonequilibrium steady-state without detailed balance, eq. ([7]) could be rewritten to 



J = ln 



Px(o)(0) 

Px(t)W 



Vln ' ' \ 



(8) 



where we used the following relationship 

dt lnp^(,) it) = dt Inp- (i) + > : 5it ~ U) In 



fc 



(9) 



Then we may interpret the first term in eq. ^ as the entropy change of system and the second term as the "excess" 
heat of the driven jump process. Under this circumstance eq. ^ is the discrete version of the Hatano-Sasa equality 0] ■ 
The last case is about nonvanishing A(t). Choosing the matrix element A„j„(<) = H„„i(t)/,„(t) — H,„„(i)/„(t) 
(m ^ n), or the flux Jmn{t) between states m and n for a distribution f(t). Obviously, the condition of /„Hm„-|-A,„„> 
0. Substituting this matrix into eq. ([5]), we obtain 



J = - / dr Inpx(r) {T)dT + ^ In ■ 



H 



:;(t-)x(t+)(*OPx(t+)(*') 
Hx(t+)x(t-)(*i)Px(t-)(*0 

To achieve obvious physical meaning of the above expression, we employ eq. © again and have 



(10) 



J = ln 



/x(0)(0) 
/x(t)(t) 



H 



x(t+)x(t-) 



H. 



:(tr)x(t+) 



(11) 



Hence, if f(i) is the distribution of the system itself satisfying the evolution eq. the first term in the equation is 
just the entropy change of the system and the second term is interpreted as entropy change of environment [tI. [io|. 
In other words, the GIFT with eq. (fTTI) is about the total entropy change of a stochastic jump process. 



IV. THE GIFT AND TIME REVERSAL FOR JUMP PROCESSES 



Like the case of continuous diffusion processes, we can connect the time-invariable inner product to be a jump 
process that is regarded to be a time-reversal of the original jump process [2^. Multiplying and rearranging on 

both sides of eq. ([3]), we have 

d ^ Af 

m— 1 m— 1 

Then we define a new function qn{s) = fnit')vn(t'), where s = t — t' and n represents an index whose components 
are the same or the minus of the components of the index n depending on whether they are even or odd under time 
reversal {t —t). We also define a new rate matrix H(s) whose elements are 

H™(s) = ,f~\t') [H™„(i')/n(i') + A™„(t')] (13) 
for m ^ n, and ilmm{s) — ^Sn/mHnm(s), respectively. Then eq. (fT2l) is rewritten as 

dqnis) 



ds 



= [H(s)q(,s)]^. (14) 



Because of the variable s = t — t' , wc interpret H(t) to be a time- reversal of the original H(t). Equation directly 
presents the reason of the time-invariable inner product {^{t')v{t') that equals l"^q(s); the latter is a constant due to 
probability conservation. 

The generalized time-reversal (jl3p includes several types of time-reversal in literature [sl. fiol. Isoj . For convenience, 
we only consider even components only in the state-index n. First, if the matrix A = and {(t') = p^^{t') satisfying 
the detailed balance condition, the time-reversed rate matrix H{t') = H(s) simply. The process determined by 
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this rate matrix was termed backward process [l^ (or a reversed protocol in Ref. [lOl)- In contrast, if p^^{t') is 
transient nonequilibrium steady-state, a process determined by Hmn(i') = fn{s)iinm{s) / fm{s) was termed an adjoint 
process (or the current reversal in Ref. [131 )■ Intriguingly, if we choose Amn{s) to be the flux Jmn{t) between the 
states m and n for a distribution f(s), we reobtain H(t') = H(s) that is the same with case of the detailed balance 
condition. Considering that these choices of f and A here are corresponding to those in Sec. IIIIl respectively, we 
see that the JE and the IFT of the total entropy have the same physical origin. It is expected in physics since a 
realization of a reversed protocol is usually possible and does not depend on whether the system satisfies detailed 
balance condition. We should point out that one may construct infinite time- reversals, because f and A are almost 
completely arbitrary, e.g., Amn(s) = aJmn(s) and < a < 1. Before ending this section, we give two comments 
about the relationship qn{s) = fn{t')vn{t'). First, for a time-independent H, if /„ is the equilibrium solution of 
the rate matrix, eq. ([3]) with zero A is just the backward master equation [2^. Second, employing the relationship 
repeatedly, we may obtain the detailed DFTs for the specific vectors f(t') and matrixes A(t') in Sec. IIIIl (the details 
see the Appendix II). 



V. CONCLUSION 



In this work we derived a GIFT for general jump processes. The existing IFTs for discrete master equations are its 
special cases. We see that, in form the GIFT for the jump cases is apparently distinct from that for the continuous 
diffusions that we obtained earlier [2^. Additionally, we also find this robust GIFT usually does not result into a 
detailed fluctuation theorem. Compared to other approaches, the major advantage of the current and previous works 
is that the time-reversal can come out automatically during the constructions of the time-invariable integral or the 
inner product, which should be direct and obvious, at least from point of view of us. Of course, A limit of our two 
works is that we did not show some applications of the two GIFTs in concrete physical systems. We hope that this 
point would be remedied in near future. 

This work was supported in part by Tsinghua Basic Research Foundation and by the National Science Foundation of 
China under Grant No. 10704045 and No. 10547002. 



APPENDIX I: THE CAMERON-MARTIN-GIRSANOV FORMULA FOR JUMP PROCESSES 



Compared to the CMC formula for continuous diffusion processes, little literature discussed the CMC formula for 
discrete jump processes. For the convenience of the readers, we give a simple derivation of the formula here. Given a 
master equation with rate matrix H. The probability observing a trajectory x(-) which starts state ni at time to = 0, 
jumps at time ti to state n2,' • • , finally jumps at time tk to Uk+i and stay till time tk+i — t is 



prob[x( 



]^exp 



H 



t.-i 



x(t-)x(t-) 



-jT)dT 



H 



■x(t-)x(t+) 



X cxp 



Hrifc+irifc+i {T)dT 



(15) 



where x(t^) — ni and x(i^) — {i — 1, ■ ■ • , A:). Assuming that there is another master equation with a different 
rate matrix H' = H -I- A, where the matrix elements of A may be negative. Then the ration of the probabilities 
observing the same trajectory in these two equations is simply 



probqx(.)] 
prob[x(-)] 



where 



Q[x(-)] = - / ^^{r)^{T){T)dT - V In 1 
Obviously, eq. ((T6)) results into a IFT 

(e-Q[x(-)]) = 1^ 



H 



x(t-)x(t+), 



(16) 



(17) 



(18) 



where the average is over an ensemble of trajectories generated from the stochastic system with the rate matrix H 
and with any initial distribution. Choosing a specific 



(19) 
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- X^m^^n ^m7i{t) = 0, we obtaiii the IFT of the house-keeping heat [1, [l^ discrete version, where 

^'^'^["(•^l = ^ n : (tw^ it-) 

Intriguingiy, replacing above by the real probability distribution Pm{t) of the system H, one obtains an IFT with 



0[x(-)]= / dr\np^ir)ir)dT + Y,T^^ 

•^0 7=1 ^x(t+)x 



{t- )i^i)Px{t- 

We notice that this functional is the almost same with that of the IFT of total entropy eq. pO|) except that the first 
term becomes minus here. In addition, the average of ((5[s(-)]) is the same with the average of the total entropy since 
the first terms of eqs. ([TT|) and (fTO|) vanish. We are not very clear whether eq. (|2T|) has new physical interpretation. 



APPENDIX II: THE DETAILED FLUCTUATION THEOREM 



Given the transition probability of eq. (fT4|) to be qn{s'\m, s) (0<s<s'<i), the previous relationship implies 

qn{s'\m, s)f„-,{t -s) = Ut - [e-^(*-^''*-^)(5,(t_,),,-„] (22) 

if one notices the initial condition (7,-j(s|to, s) = 5n^m, where we use J^{t — s',t — s) to denote the functional eq. ([5]) 
with the lower and upper limits t — s' and t — s, respectively, and 5 is the Kronecker's. Now we consider a mean of a 
{k + l)-point function over the time- reversed system ()14p . 

(-F[x(sfc), • ■ • ,x(.so)])tr = ^ q„Jsfc|ri,fe_i,Sfc_i) • • ■g„i(si|ri,o,so)(?„(,(so)-F(fife, ■ • ■ ,no) (23) 

where Q=sq<si<- ■ ■ <Sk—t and q(so) is the initial distribution. If we choose a specific q„(, (sq) — fno{t ~ sq) and 
employ eq. (|22p repeatedly, the right hand side of the above equation becomes 

(e--^[^'^'^l^^[x(io), • ■ • , x(i,)]) - f^-^^ - Sk)E'^-^*~^^ {e-'^("'*)^^[x(t - s^), • • • , x(t - so)]} . (24) 

Here we define U = t — Sk-i and O=to<^i<' • • <tk=t. On the basis of the above discussion, if fc ^ oo the function F 
becomes a functional JF over the space of all trajectories x, and we get an identity 

(^)tr = (e--^['''f'^I.F), (25) 

where .F(x) = J'i^) and x is simply the time-reversed trajectory of x. This is a generalization of Crooks' relation (3]. 
Obviously, choosing J' constant, one obtains the GIFT ([6]). An important following question is whether the GIFT 
results into a DFT. For the specific matrixes A(^) and vectors i{t) in sec. IIIIl we indeed obtain several DFTs 

Ptr{-J) = P{J)e-', (26) 

by choosing JF(x) = (5(J'[x, f. A] — J), where P{J) is the probability distribution for the quantity J7 achieved from 
the jump process ([2|) and PTniJ) is the corresponding distribution from the time-revered system ()14p . For any a pair 
of A and f, eq. (|26p usually does not hold. 
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